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Abstract 

Stochastic differential equations (SDE) are widely used in modeling stochastic dynamics in liter- 
ature. However, SDE alone is not enough to determine a unique process. A specified interpretation 
for stochastic integration is needed. Different interpretations specify different dynamics. Recently, 
a new interpretation of SDE is put forward by one of us. This interpretation has a built-in 
Boltzmann-Gibbs distribution and shows the existence of potential function for general processes, 
which reveals both local and global dynamics. Despite its powerful property, its relation with clas- 
sical ones in arbitrary dimension remains obscure. In this paper, we will clarify such connection 
and derive the concise relation between the new interpretation and Ito process. We point out that 
the derived relation is experimentally testable. 
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I. INTRODUCTION 



Stochastic processes universally exist in nature as well as human society. One of the 
most popular tools, stochastic differential equation (SDE) has a long history of being used 
to model continuous processes in physics and chemistry [8, 23]. Recently, there is a growing 
trend to apply it in biology, from complex networks [3, 4, 19, 25] to evolution dynamics 
[11, 29]. 

However, due to the intrinsic richness of SDE, one will encounter an ambiguity in choosing 
integration method when applying SDE to model practical problems [24]. There are already 
some well established integration methods in literature, Ito, Stratonovich, for example [8]. It 
is known that they are consistent in their own mathematical framework and their relations 
have been addressed [16, 20, 26]. While researchers are aware that different interpretations of 
SDE have different applied meanings [22], it turns out that in practice people tend to choose 
integration method by professional preference: mathematician prefer Ito due to martingale 
property, engineers prefer Stratonovich owing to chain rule. What we want to emphasize 
here is that when dealing with practical problems, careful consideration should be taken for 
such ambiguity. 

The fact that different integration methods lead to different processes can be best shown 
by their corresponding Fokker-Planck equations (FPE). In contrast to SDE, FPE is complete 
and deterministic, describing the ensemble evolution of processes. A given SDE with a 
specified integration method corresponds to a unique FPE. Accordingly, A given SDE with 
a specified FPE indicates an integration method. Thus, to determine a system described by 
an SDE, one can either specify the integration method, or assign a certain FPE to it. 

Recently, a new interpretation framework for SDE is formed by one of us while studying 
a biological stability problem [31]. This interpretation, instead of specifying the integration 
method of SDE explicitly, transforms the SDE into a canonical form (Equation 6) and links 
it with a special FPE with the same structure. This novel construction shows the existence 
of the potential function [17, 28] for general processes, which reveals local dynamics via SDE 
and global dynamics via Boltzmann-Gibbs distribution. 

Real- world systems using this kind of SDE interpretation have been found [24]. Related 
issues have been considered along the line [2, 5, 14, 15, 27]. However, the relation between the 
new interpretation and classical ones in arbitrary dimension has not been clearly addressed. 

2 



In addition, such relation may have experimental implications. In this paper, we will derive 
the relation between the new interpretation and Ito process and discuss how to tell the 
differences between different interpretations. 

We will review classical SDE integration methods in section 2. The new interpretation 
will be introduced in section 3, followed by its relation with Ito process. Conclusion can be 
found in the end. 

II. CLASSICAL SDE INTEGRATION METHODS 

In this section, we review the definitions of classical SDE integration methods and de- 
rive the relation between them. There are usually two ways to write an SDE, namely the 
Langevin form in physics and the mathematical form [23]. We apply the latter in this paper. 

A typical mathematical formulation of SDE is given by the following formula 

d x = f(x(*))dt + B(x(*))d W{t), BB T = 29 D(x). (1) 

For simplicity, we only consider time homogeneous process. Here x is a n dimensional 
variable and f{x) is the drift force, either linear or non-linear, d W(t) is a m dimensional 
Gaussian white noise with zero mean and variance dt. B(x) is a n x m matrix. 9 is a non- 
negative constant playing the role of temperature and D(x) is the symmetric and positive 
semi-definite diffusion matrix. SDE does not contain information for choosing x(*) here, that 
is where different integration methods differ from. In the following, we will talk about the 
connections between classical interpretations. Although this is known, such demonstration 
will make our later discussion more clear. 

Consider a time interval [t, t + dt], a general form which we call a-type integration inter- 
prets Equation 1 as follows 

dx = f(x(t + adt))dt + B(x(t + adt))d W(t), B B T = 29 D(x), a e [0, 1]. (2) 

To see why a matters here, we shall take a close look at the approximate orders. In fact, 
like ordinary differential equation, a does not affect the deterministic term. This is because 
different ways of choosing a for the drift force only lead to a difference of order o(d£). But 
it is another story for SDE. Note that d x is of order 0(\/di) due to the noise d W(t). This 
leads to an order 0(v / dt) change of B(x), combined with d W(t) resulting order O(dt) 
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change of dx. Thus, choosing different a would lead to a total difference of order O(dt) for 
d x, which can not be ignored. This issue has been addressed mathematically by Wong and 
Zakai in 1965 [26]. Noting that the Ito [18], Stratonovich [23], and Hanggi [9] integration 
methods correspond to a = 0, a = 1/2, a = 1 type processes separately. 

The following theorem summarizes the relation between a-type and Ito type (I-type) 
integration method and an intuitive derivation can be found in appendix. 

Theorem II. 1 (a -I relation) 

For an a-type SDE Equation 2, the equivalent I-type SDE is 



With above results, one can use I-type process to simulate a-type process with a modification 
of drift force. Note that for a specific SDE with constant B, all a-type interpretations lead 
to an identical process. 

In the end of this section, we mention that in order to uniquely determine a process, one 
can specify the interpretation for Equation 1. Alternatively, one can also write the Fokker- 
Planck equation (FPE) of the process. The FPE describes the evolution of probability 
distribution function of a process. A given SDE with a specific interpretation describes a 
determined process, thus corresponds to a determined FPE. The FPE of Equation 1 with 
I-type interpretation is [8, 12, 18, 23] 



With the relation we obtained, one can get the corresponding a-type FPE according to 
Equation 3. 

III. POTENTIAL FUNCTION VIEW INTERPRETATION OF SDE 

In this section, we introduce the potential function view interpretation of SDE formed by 
one of us recently. We call this A-type for short. It first decomposes the deterministic force 
and rewrite Equation 1 into the following form 



da; = [f(x) + h(x)} dt + B(x)d W{t) 
where hi(x) = a ^ y^ j (d k B ij (x))B kj (x). 



(3) 



j k 





d x 



[D(x) + Q(x)]V(f)(x)dt + B(x)*d W{t), BB T = 29 D(x), 



(5) 
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where D is the symmetric positive semi-definite diffusion matrix and Q is an anti-symmetric 
matrix. Here is a scaler function playing the role of potential function in physics. Then it 
transforms the above equation into the following equation 

[S(x) + T(x)]d x = -V(/)(x)dt + B(x)*d W(t), BB T = 20S(x), (6) 

where S is a symmetric positive semi-definite matrix and T is an anti-symmetric matrix. 
The transformation is based on the following assumption: Deterministic part and stochastic 
part corresponds to the original ones separately. Subsequently the relation, the so-called 
generalized Einstein relation [2], directly follows: 

[S(x) + T(x)] D(x)[S(x) - T(x)] = S(x). (7) 

In one dimensional case, the above relation reduces to the well known Einstein relation. 
For higher dimensional cases, the generalized Einstein relation is a new prediction from our 
approach and can be tested experimentally. 

We have a power series expansion method [1] to generally construct the form (Equation 
6). Furthermore, situation near fixed points are exhaustively studied [14] and limit cycle case 
is explicitly constructed [30]. Equation 6 is analogous to the the dynamics of a "massless" 
charged particle in viscous liquid with presence of electrical and magnetic field, where S 
and T play the role of dissipative force and magnetic field separately and V(f)(x) as the 
electrical field, a detailed example can be found in [2]. Note that the physical status of 
potential function <p(x) is same as classical ones, with the capability of generalizing into 
non-equilibrium situation. 

Via applying a process of zero mass limit with 2n dimensional Klein-Kramers equation 
in physics, it has been shown that Equation 6 corresponds to the following n dimensional 
Fokker-Planck equation [27] 

d t p(x) = V T {[D(x) + Q(x)]\y<f>(x) + eV]p(x)}. (8) 

To our best knowledge, previous works concerning zero mass limit procedure such as [7, 
10, 13] have never reached our form of SDE. Our approach involves both magnetic field 
and Einstein relation. Note that this procedure is also consistent within A-type framework 
[5]. Equation 8 has a very nice property that its stationary distribution is in the form of 
Boltzmann-Gibbs distribution 

(9) 



x 



tt(x) oc exp 
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This new construction shows that one can find a potential function with both local and 
global meanings for a general process, even in cases without detailed balance condition, i.e., 
with nonzero T. The potential function is responsible for local dynamics via SDE and global 
state via Boltzmann-Gibbs distribution. It is quite powerful that with it one can find out 
the final state of the system without going through the dynamics. Apart from the potential 
function, S and T that are responsible for dynamics also has physical meanings, namely the 
dissipative force and the magnetic field. In addition, combining Equation 6 and Equation 
9, we can see that the states with extremal stationary probability coincides with the states 
with zero drift force. 

With those nice properties, this method has been successfully applied to solve an impor- 
tant biological stability problem [31]. Just as an engineering experiment show good agree- 
ment with Stratonovich integration method [21], a recent physical experiment [24] turn out 
to favor the A-type integration in one dimensional case. As generalized Einstein equation 
can be experimentally tested, we are looking forward to higher dimensional experimental 
results. 

Notice that this new construction does not explicitly specify a classical integration method 
for the original SDE. Instead, it specifies the dynamics by linking an FPE to the original 
SDE. One may wonder what is the relation between this construction and the classical ones 
and how to choose a specific interpretation to deal with real problems. We will address these 
questions in the following. 

A. A-I relation 

Since we know the FPE for all the different integration methods, we can seek their 
relations from FPE, that is, the connection based on distribution function perspective. The 
relation between A-type and I-type interpretations are given by the following theorem. 

Theorem III. 1 (A-I Relation) 
A-type SDE in the following form 




(10) 
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(11) 



Can be converted into I-type SDE 

dx = f(x)dt + B(x)dW(t) 

= {-[D(x) + Q(x)]V(f>(x) + 9Af(x)}dt + B(x)dW(t), 
where the additional drift term is defined by 

Af i (x) = Y t d j [Dv(x) + Q i ,.(x)]. (12) 

j 

Proof III.l In order to convert A-type FPE into I-type FPE, we rewrite Equation 8 into 
a more detailed form 



<9 tP (x) =$> YPiM) + Q ii (x)]p(x)a^(x) 

i I 3 

+ e E * I X>« ( x ) + Q*;( x )]^( x ) 



(13) 



VKe irani to convert it into I-type FPE (Equation 4)- By comparing the two equations, we 
can find the difference lies in the second part of both equations. We start from decomposing 
the second part of I-type FPE 

(14) 

=6 dm Dy (x)]p(x)} + 9 a{D«(x)0 iP (x)}. 

We can find the second term is part of the second term in Equation 8. For the remaining 
part in Equation 8, we analyze it further as 



h3 



'■j 



(15) 



p(x) > (by anti — symmetric property of Q(x)). 



With the above results, we are ready to transform the second term of A-type FPE 



eJ29i\ X)[py(x) + Qy(x)]a,-p(x) 



5]fl i (Dy(x) + Qy(x)) 



(16) 



p(x) +^^[D l ,(x)p(x)] ; 



'■J 
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noting that the first term of A-type FPE is already same with I-type, we can find that the 
additional drift term is as Equation 12 shows. 

Although A-type framework implicitly, via 2n dimensional Klein-Kramers equation, de- 
termines the integration method by linking an FPE to the given SDE in n dimension, we 
may simulate its process with modified I-type process using the above relation directly in 
n dimension. We should also note the following fact: In one dimensional case where Q 
vanishes, the additional fixing term makes A-type FPE to be a-type FPE where a = 1. 
However, this does not hold in higher dimensions, where A-type FPE is no longer identical 
to any a-type FPE in general, even when B is constant. This is because the anti-symmetric 
matrix Q can also give the additional fixing term. While when B is constant, all the a-type 
integration methods are identical to each other. Following two examples serve to show the 
differences between I-type and A-type processes. 

Example III.l (Shift of stable point) Figure 1 (a)(b) shows the density histograms of long 
time trajectories of I-type process and A-type process. These two processes are generated 
from an identical SDE with constant D and state dependent Q and the drift force of the 
SDE has the origin as its stable fixed point. For the I-type process, there is a shift between 
its most probable state and the origin, while A-type process keeps the origin as its most 
probable state. Figure 1 (c) shows the sampling shift distance from the origin via changing 
a parameter of Q. Detailed parameters can be found in appendix. 

Example III. 2 ( Change of global shape) Figure 2 shows the density histograms of long time 
trajectories of I-type process and A-type process. These two processes are generated from an 
identical SDE with state dependent D and zero Q. Note that the drift force of the SDE has 
a circle as its stable fixed points and the origin as its unstable fixed point. In this setting, 
the stationary distributions of I-type and A-type processes show significant differences. For 
the I-type process, the unstable fixed point becomes the most probable state. On the contrary, 
A-type process keeps the stable fixed points (the circle) as its most probable states. 

Two remarks are in order. First, the noise induced shifts of bifurcations have been 
amply studies in literature, see for example, [6], but here we study it from A-type approach 
perspective. Second, we should point out that those examples may well be what may occur 
experimentally. A real physical experiment is discussed in next section as a concrete example 
to further illustrate such possibility. 
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(a) I - type 



(b) A - type 



CO 



* I-type 



[a) sliift distance from the origin 



FIG. 1. (Color online) Top: Density histograms of long time trajectories of I-type process(a) 
and A-type process(b) in Example III.l. The origin is pointed out with intersection of red lines. 
Different colors indicate different density, and lighter color represents higher density. Down: The 
distance between the origin and the most probable state(the lightest point in (a)(b)) for I-type 
process(Blue) and A-type process(Red) with different values of the parameter k. 

B. Stationary distribution- 1 dimensional case 

When dealing with a real process and the SDE is given, how to choose the integration 
method? Since the FPE uniquely determines the process, we can refer to its stationary 
distribution. As we discussed in the previous section, different interpretations will result 
in different stochastic process, thus lead to different stationary distributions. A proper 
interpretation should lead to the stationary distribution of the real process. In the following, 
we will consider stationary distribution of different methods in one dimensional case. The 
temperature 9 is set to 1 for simplicity. 

For the following one dimensional SDE 

dx = -D(x)(f)'(x) + B{x)d W{t), (17) 
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(a) I - type sampling lesiilt 




(b) A - type sampling result 



FIG. 2. (Color online) Density histograms of long time trajectories of I-type process(Top) and 
A-type process(Down) in Example III. 2. Left panels show the density difference with altitude and 
right panels with color lightness. 

the corresponding I-type FPE is 

d tP (x) = -d x [-D(x)<P'(x)p(x) - d x (D(x)p(x))]. (18) 

Applying Theorem II. 1, note that only in one dimensional case, once D is determined, 
different possible forms of B will not affect the modification term. Hence we can get the 
a-type FPE as following 

d t p(x) = -d x [-D(x)(j ) '(x)p(x) - D a (x)d x (D l ~ a (x)p(x))]. (19) 

Its stationary distribution is 

p(x) oc D a ' 1 (x)e- (l ' [x) . (20) 

Note that when a — 1, the above stationary distribution is Boltzmann-Gibbs distribution, 
same with A-type interpretation. A real physical experiment done recently favors this in- 
terpretation in one dimensional case [24]. 
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Above results show that even for one dimensional case, when D is not constant, different 
integration methods lead to different stationary distributions. This fact reminds us to pay 
attention when choosing integration methods. 

For higher dimensional cases, usually one can not write down the stationary distribution 
for a-type integration directly, due to the emergence of the breaking detailed balance term 
T. While for A-type interpretation, one can always write down the stationary distribution 
directly, which is the Boltzmann-Gibbs distribution (Equation 9). 



IV. CONCLUSION 

In this paper, we discussed the relations between several SDE integration methods, in- 
cluding classical ones and a recent framework introduced by one of us. Their experimental 
implications are also discussed. 

The richness nature of SDE has long been known by literature. Different integration 
methods are all mathematically consistent within their own framework. Thus there may 
be illusion that we can apply them arbitrarily as we like. While the fact is we should pay 
attention to the pseudo freedom, since the real process is unique. In real process it is always 
hard to determine which method we should take, but we can always refer to the FPE for 
help, since it uniquely determines a process. 

A-type framework is mysterious at first sight. Instead of specifying integration explicitly, 
it directly connecting SDE and FPE in their special form. With the special form of FPE, 
its stationary distribution enjoys the property of Boltzmann-Gibbs distribution. Though it 
does not specify how the actual process is integrated, by comparing the FPE with I-type 
FPE we can find a way to convert A-type parameters into I-type ones. Hence simulate 
A-type processes by I-type processes. It is interesting to note that A-type decomposition 
has a discrete state counterpart, which will be discussed elsewhere. 

We have shown that A-type SDE is not a special kind of a-type SDE. So a-type has not 
cover all the existing interpretations of SDE. We now end here with a question for readers: 
is there a more general form of stochastic integration which can unify all the mentioned 
types of integration? 
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Appendix A: Proof of theorem II. 1 

Proof A.l We only need to consider the difference between a-type and I-type processes 
(a = 0), the difference in drift part is given by 



This means the difference in drift part is negligible. The difference in diffusion part of ith 
coordinate is given by 



[f(x(t + adt)) - f(x(*))]dt = O (x(t + adt) - x(t)) dt = 0(dt 15 ) = o(dt). 



(Al) 




(A2) 



3 




(A3) 



3 




(A4) 



3 k,s 




(A5) 
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We can use interpretation of SDE over time interval t to t + adt to get Equation A3. Here 
dW(ai) is a short notation for change of Wiener Process over time adt. Equation A4 is 
given by first order expansion. We get the last equality using the following facts 

dW i(at)dW j(t) = \ Kl ^ l ^ 3, (A6) 

I adt + R 2 (t) i = j. 

Here Ri(t) and R^t) are zero mean noise with standard deviation of order o(y/d~t) . These 
small noise will not harm the result and can be ignored according to the following theorem. 

Theorem A.l The zero mean noise in dx with standard deviation o/o(v / dT) can be ignored 
without influencing the result of stochastic integration. 

Proof A. 2 Let us denote the noise term R(£). Consider the stochastic integration of the 
noise term over a time interval 

X = / R(t) = lim R (^) (A7) 
Jt=o N ^°° ~t 

We can find that X is a random variable with zero mean and zero variance ( due to the fact 
that variance o/R(t) is o(dt) ). This means X goes to by mean-square limit. 



Appendix B: Detailed parameters of examples 

1. Example III.l 

The SDE for the I-type process is 

dx = -(D+ Q)V(j)dt + Bd W(t),BB T = 2 D (Bl) 

Where 

\ V ) \ 10 ) \ -ky J 

Where k is an integer vary from 1 to 10. The A-type process for Equation Bl is the following 
I-type process: 

dx = [-(£>+ Q)V0 + A f}dt + Bd W{t) (B3) 

where 

A/= ( * | (B4) 
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2. Example III. 2 



The SDE for the I-type process is 

dx = -DV(j)dt + BdW(t),B B T = 2D (B5) 

Where 









-1 




\,B-( 




yy ) 





x 2 + y 2 
^x 2 + y 2 



-log(x 2 + y 2 ) + (x 2 + y 2 )/2 (B6) 



It is easy to see that the above I-type process is the equivalent I-type process for the following 
A-type process with same B and different <j): 

dx = -D V0'dt + £*d W(t),BB T = 2D (B7) 

Where 

0' = (x 2 + y 2 )/2 (B8) 

So its stationary distribution is 

p oc exp [-(x 2 + y 2 )/2] (B9) 

This stationary distribution has only one minimum point at origin. 
The A-type process for Equation B5 is the following I-type process: 

dx = [-DV(f) + Af}dt + BdW(t) (BIO) 

where 

Af= {l) (BU) 

And its stationary distribution is 

p oc exp [log(x 2 + y 2 ) - [x 2 + y 2 ) /2] (B12) 
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